Improving Human Decision-making by Discovering Efficient Strategies for Hierarchical Planning
نویسندگان
چکیده
Abstract To make good decisions in the real world, people need efficient planning strategies because their computational resources are limited. Knowing which would work best for different situations be very useful understanding and improving human decision-making. Our ability to compute those used limited small simple tasks. Here, we introduce a cognitively inspired reinforcement learning method that can overcome this limitation by exploiting hierarchical structure of behavior. We leverage it understand improve large complex sequential decision problems. decomposes problems into two sub-problems: setting goal how achieve it. discover optimal larger more tasks than was previously possible. The discovered better tradeoff between quality cost both existing algorithms. demonstrate teaching use significantly increases level resource-rationality require up eight steps ahead. By contrast, none previous approaches able performance on these These findings suggest our informed approach makes possible decision-making Future develop support systems world.
منابع مشابه
Improving process models by discovering decision points
Workflow management systems (WfMS) are widely used by business enterprises as tools for administrating, automating and scheduling the business process activities with the available resources. Since the control flow specifications of workflows are manually designed, they entail assumptions and errors, leading to inaccurate workflow models. Decision points, the XOR nodes in a workflow graph model...
متن کاملExploration strategies in human decision making
The tradeoff between pursuing a known reward (exploitation) and sampling unknown, potentially better opportunities (exploration) is a fundamental challenge faced by all adaptive organisms. Theories formalize the value of exploration (gathering information) as an information bonus. However, this may be difficult to compute; a simpler alternative is to increase decision noise, driving random expl...
متن کاملHierarchical Decision Making by Autonomous Agents
Often, decision making involves autonomous agents that are structured in a complex hierarchy, representing e.g. authority. Typically the agents share the same body of knowledge, but each may have its own, possibly conflicting, preferences on the available information. We model the common knowledge base for such preference agents as a logic program under the extended answer set semantics, thus a...
متن کاملHierarchical Decision Making
Decision making must be made within an appropriate context; we contend that such context is best represented by a hierarchy of states. The lowest levels of this hierarchy represent the observed raw data, or specific low-level behaviors and decisions. As we ascend the hierarchy, the states become increasingly abstract, representing higher order tactics, strategies, and over-arching mission goals...
متن کاملImproving Decision Diagrams for Decision Theoretic Planning
In the domain of decision theoretic planning, the factored framework (FMDP) has produced optimized algorithms using Decision Trees (SVI, SPI) and Algebraic Decision Diagrams (SPUDD). However, the state-of-the-art SPUDD algorithm requires i) the problem to be specified with binary variables and ii) the data structures to share a common order on variables. In this article, we propose a new algori...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computational Brain & Behavior
سال: 2022
ISSN: ['2522-0861', '2522-087X']
DOI: https://doi.org/10.1007/s42113-022-00128-3